虛擬髮型變換

Simulation of Face/Hairstyle Swapping in Photographs
with Skin Texture Synthesis

Jia-kai Chou  Chuan-Kai Yang

Computer Graphics & Multimedia Lab., NTUST


 

Abstract

The modern trend of diversification and personalization has encouraged people to boldly express their differentiation and uniqueness in many aspects, and one of the noticeable evidences is the wide variety of hairstyles that we could observe today. Given the needs for hairstyle customization, approaches or systems, ranging from 2D to 3D, or from automatic to manual, have been proposed or developed to digitally facilitate the choice of hairstyles. However, nearly all existing approaches suffer from providing realistic hairstyle synthesis results. By assuming the inputs to be 2D photos, the vividness of a hairstyle re-synthesis result relies heavily on the removal of the original hairstyle, because the co-existence of the original hairstyle and the newly re-synthesized hairstyle may lead to serious artifact to human perception. We resolve this issue by extending the active shape model to more precisely extract the entire facial contour, which can then be used to trim away the hair from the input photo. After hair removal, the facial skin of the revealed forehead needs to be recovered. Since the skin texture is non-stationary and there are little information left, the traditional texture synthesis and image inpainting approaches do not fit to solve this problem. Our proposed method yields a more desired facial skin patch by first interpolate a base skin patch, and then acquire non-stationary texture synthesis. In this paper, we also would like to reduce the user assistance during such a process as much as possible. We have devised a new and friendly facial contour and hairstyle adjusting mechanism that make it extremely easy to manipulate and fit a desired hairstyle onto a face. In addition, our system is also equipped with the functionality of extracting the hairstyle from a given photo, which makes our work more complete. Moreover, by extracting the face from the input photo, our system allows users to exchange faces as well. In the end of this paper, our re-synthesized results are shown, comparisons are made, and user studies are conducted as well to further demonstrate the usefulness of our system.

摘要

現今社會中,人人都有追求擁有出色外貌的權利及渴望,雖然整容手術是逐漸風行的一種做法,但對消費者來說,整容所需承擔的風險性和所需付出的費用,仍相當可觀!相較之下,變更一個人的髮型,除了可以修飾臉形,同時可以達成轉變風格的效果,使其在人群之中能獨樹一格。且較無危險之虞,在花費的金額上也較為低廉。


本論文提出一個系統架構,讓使用者透過簡單且直覺的系統介面,能夠輕鬆且快速地得到“虛擬髮型變換“的效果。在我們的系統中,使用者只需輸入一張2D 的人像照片,並於髮型資料庫中選取喜歡的髮型,本系統便可以完全自動的方式將人臉和髮型結合,輸出一張將人像變換髮型後的影像,亦可將輸入影像中的髮型取出,並加入髮型資料庫中!

 


Related Material(s) : Video(.avi)